Evaluation of the Scusi? Spoken Language Interpretation System - A Case Study
نویسندگان
چکیده
We present a performance evaluation framework for Spoken Language Understanding (SLU) modules, focusing on three elements: (1) characterization of spoken utterances, (2) experimental design, and (3) quantitative evaluation metrics. We then describe the application of our framework to Scusi?— our SLU system that focuses on referring expressions.
منابع مشابه
Considering Multiple Options when Interpreting Spoken Utterances
We describe Scusi?, a spoken language interpretation mechanism designed to be part of a robot-mounted dialogue system. Scusi?’s interpretation process maps spoken utterances to text, which in turn is parsed and then converted to conceptual graphs. In order to support robust and flexible performance of the dialogue module, Scusi? maintains multiple options at each stage of the interpretation pro...
متن کاملA spoken language interpretation component for a robot dialogue system
The DORIS project aims to develop a spoken dialogue module for an autonomous robotic agent. This paper examines the techniques used by Scusi?, the speech interpretation component of DORIS, to postulate and assess hypotheses regarding the meaning of a spoken utterance. The results of our evaluation are encouraging, yielding good interpretation performance for utterances of different types and le...
متن کاملKnowledge and Reasoning in Practical Dialogue Systems
We describe Scusi?, a spoken language interpretationmechanism designed to be part of a robot-mounted di-alogue system. Scusi?’s interpretation process mapsspoken utterances to text, which in turn is parsed andthen converted to conceptual graphs. In order to sup-port robust and flexible performance of the dialoguemodule, Scusi? maintains multiple options at eachstage ...
متن کاملA Probabilistic Approach to the Interpretation of Spoken Utterances
In this paper we describe Scusi?, the speech interpretation component of a spoken dialogue module designed for an autonomous robotic agent. Scusi? postulates and maintains multiple interpretations of the spoken discourse, and employs a probabilistic formalism to assess and rank hypotheses regarding the meaning of spoken utterances. These constituents in combination enable Scusi? to cope gracefu...
متن کاملHypothesis Generation and Maintenance in the Interpretation of Spoken Utterances
The DORIS project (Dialogue Oriented Roaming Interactive System) aims to develop a spoken dialogue module for an autonomous robotic agent. This paper examines the techniques used by Scusi? , the speech interpretation component of DORIS, to postulate and assess hypotheses regarding the meaning of a spoken utterance. The results of our evaluation are encouraging, yielding good interpretation perf...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2013